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ABSTRACT 



Current theories of metacognition suggest that effective control of learning by either 
metacognitive or self-regulatory processes cannot occur without accurate monitoring of 
lear nin g Given this theoretical framework, there are questions of whether knowledge 
monitoring and self-regulated learning abilities are domain specific or whether 
metacognitive processes, in particular knowledge monitoring ability, generalizes across 
academic domains. This study examines that issue by exploring the correlations among 
measures of metacognitive knowledge monitoring, learning and study strategies, and 
academic achievement across the domains of verbal ability and mathematics. Using 
parallel measures of knowledge monitoring in both the verbal and mathematical domains, 
120 students estimated their metacognitive knowledge, reported their confidence in the 
accuracy of those estimates, and completed a self-report measure of learning and study 
strategies. Results suggest that metacognitive knowledge monitoring is generalizable across 
both the verbal and mathematical domains (r = .49, p<.01). , The correlations between the 
two knowledge monitoring measures and students’ confidence estimates (r=.30, and .53, 
p<.01) were also in the expected directions. Moreover, both knowledge monitoring 
measures correlated with students’ gpa (r = .35 and .24, p<.01, respectively). The 
correlations with the LASSI subscales, however, were not significant, although a number 
of LASSI subscale scores did correlate significantly with gpa. The findings are discussed 
wi thin the framework of current theory in metacognition and contemporary conceptions of 
strategic learning. 
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INTRODUCTION 



Metacognition has been defined as the ability to monitor, evaluate, and make plans for 
one's learning (Flavell, 1979; Brown 1980). The literature in this area identifies two 
distinct aspects of metacognition, knowledge about cognition and the regulation of 
cognition, with both viewed as important for effective learning (Brown, 1987; Gamer and 
Alexander, 1989; Jacobs and Paris, 1987). Indeed, researchers have reported differences in 
metacognitive abilities between capable and less capable learners (see, for example, Baker, 
1989; Brown and Campione, 1986; Gamer and Alexander, 1989; Pressley and Ghatala, 
1990). In general, students with effective metacognitive skills accurately estimate their 
knowledge in a variety of domains, monitor their on-going learning, update their 
knowledge, and develop effective plans for new learning. 

Though widely recognized as important, assessing individual differences in 
metacognition has proven to be both difficult and time consuming (O'Neil, 1991; Schwartz 
and Metcalfe, 1994), and remains an obstacle to the advance of research. Typically, 
assessments of metacognition rely either on inferences from classroom performance, or 
ratings based on interviews of students who are questioned about their knowledge and 
cognitive processing strategies, or on analyses of "think-aloud" protocols (Meichenbaum, 
Burland, Gruson, & Cameron, 1985). Recently, a number of self-report measures of 
metacognition (Everson, Hartman, Tobias, and Gourgey, 1991; O'Neil, 1991; Pintrich, 
Smith, Garcia, and McKeachie, 1991; Schraw and Dennison, 1994) have been developed. 
For the most part, these measures are more efficiently administered and scored than “think 
aloud” protocols. Unfortunately, the use of self-report measures raises questions of 
validity (see Schwartz and Metcalfe (1994) for a review of these methodological issues). 

In light of these concerns, it is not surprising that litde research has been conducted on the 
metacognitive processes related to learning in adults, looking, for example, at those in 
college or in advanced instructional or training programs, where instructional times less 
easily accommodates research. Thus, more efficient measures of metacognition are needed 
not merely to satisfy psychometric standards (although important), but because they would 
permit research in settings where instructional time is less flexible, such as college 
classrooms and training courses. 
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In this paper we introduce a method for assessing students” knowledge monitoring 
abilities (referred to generally as the KMA) in two salient academic domains, verbal ability 
and mathemati cs, and we relate these measures to self-report indices of learning and study 
strategies and to academic performance in college. Before presenting our results, it may be 
useful to establish the context for investigating the relationship between metacognition and 
complex learning in environments such as college and industry-based training courses. 

Metacognition and Learning 

In college students leam a great deal of new knowledge, and are faced, at times, with 
classroom and laboratory situations that require them to leam material and apply problem 
solving skills in new and innovative ways. The literature on human metacognition makes a 
compelling case for its importance in these learning and training environments (Bjork, 
1994; Davidson, Deuser, and Sternberg, 1994). Accurate monitoring of new learning 
enables students with effective metacognitive strategies to concentrate on new content and 
adjust their learning goals. In college classrooms or advanced training programs, for 
example, the learner usually has to master a great deal of new knowledge in a limited 
amount of time. Moreover, learning in classrooms or other structured training 
environments is often dynamic, with knowledge and information being acquired and 
updated frequently. Clearly, those who accurately distinguish between what they have 
already mastered and what is yet to be learned have an advantage in these situations, since 
they can be more strategic and effective learners. Yet many students have ineffective 
metacognitive strategies. It is important, therefore, to evaluate students' metacognitive 
abilities and target instruction to the development of these key learning strategies. 

Monitoring Knowledge 

Given the premise outlined above, we assumed that knowledge monitoring accuracy, an 
ability presumably involved in the regulation of cognition, would be related to learning in 
complex environments and reflected in indices such as students’ grades in college. Thus, 
we developed a technique for assessing this metacognitive dimension that conjointly 
evaluates students’ self-reports of their knowledge in a domain (e.g., verbal ability or 
mathematics) and their performance on an objective measure of knowledge in that domain 
(see, for example, Everson, Smodlaka, and Tobias, 1994; Tobias and Everson, 1996; 
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Tobias and Everson, in press). The basic strategy is to assess knowledge monitoring by 
evaluating the differences between students’ estimates of their knowledge in a particular 
domain (both procedural and declarative) and their actual knowledge as determined by 
performance on a test In the prototypical KM A, students are asked to estimate their 
knowledge (e.g., in the verbal domain they identify words they know or do not know from 
a word list or in mathematics its in problems they expect they can solve) and these 
es timates are contrasted with their performance on a standardized test containing many of 
the same words or math problems. Differences between students’ estimates and their test 
performance provide an index of knowledge monitoring ability. This approach is similar to 
methods used in research on metamemory (Nelson and Narens, 1990), reading 
comprehension (Glenberg, Sanocki, Epstein and Morris, 1987), and psychophysics 
(Green and Swets, 1966). A brief description of our use of the KMA in an earlier study 
(Everson et al., 1994) serves as an illustration. 

In an effort to understand better the relationship between metacognition and reading 
comprehension, the KMA was administered to 169 college students. Each was given a list 
of 33 words and asked to indicate the words they knew and did not know. This was 
followed by a vocabulary test based on the same words. The KMA generated four scores, 
including estimates that the word was: a) known and correctly identified on a subsequent 
vocabulary test [+ +]; b) known, yet incorrectly identified on the test [+ -]; c) unknown, 
yet correctly identified on the test [- +]; and d) unknown and incorrectly identified on the 
test [- -]. Within this framework the [+ +] and the [- -] scores represented accurate 
metacognitive estimates of vocabulary word knowledge, while the two other measures [+ -, 
and - +] represented inaccurate knowledge monitoring estimates. The results indicated that 
college students’ accurate metacognitive judgments, both the + + and - - scores, were " 
positively correlated with their scores on a standardized measure of reading comprehension 
(i.e., the Descriptive Test of Language Skills, 1979), r = .46 and -.43, respectively. 
Encouraged by these findings, we adapted the KMA for use in an extensive program of 
research (Tobias and Everson, 1996; Tobias and Everson, in press). 

Learning and Study Strategies 

As we noted earlier, there has been a growing research interest in the role that 
metacognitive abilities play in facilitating learning in complex environments. In addition to 
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the work on metacognitive knowledge monitoring, interest in the more general leaming-to- 
leam phenomena continues to increase (see, for example, Nickerson, Perkins, & Smith, 
1985; Weinstein & Mayer, 1986; Weinstein, Goetz, & Alexander, 1988; Zimmerman & 
Schunk, 1989). In general, this research suggests that effective learning depends not only 
on what the learner knows about a given subject or academic domain, but also what the 
learner thinks about prior to, during, and after the learning activity— i.e., the strategic aspects 
of lea rnin g. Weinstein (Weinstein & Mayer, 1986; Weinstein et al., 1988) refers to these 
as learning and study strategies, which include... “a variety of cognitive processes and 
behavioral skills designed to enhance learning effectiveness and efficiency” (Weinstein & 
Meyer, 1991, p. 41). In an effort to assess these aspects of effective learning, Weinstein, 
Schulte, and P alme r (1987) developed the Learning and Study Strategies Inventory 
(LASSI), a self-report instrument that includes measures of attitude, motivation, time 
management, anxiety, concentration, information processing, selecting main ideas, study 
aids, self testing, and test strategies. 

In an effort to refine our understanding of the cognitive processes underlying 
effective learning, we sought to examine the patterns of relationships among the LASSI 
subscales to the knowledge monitoring estimates derived from the KMA measures in both 
the verbal and mathematical domains. By viewing the metacognitive components of 
learning in this manner, we hope to gain additional understanding of the contextual 
boundaries of cognition (Perkins & Salomon, 1989). Thus, the objectives of the research 
reported below are (1) to examine the empirical relationships between and among the 
KMA scores, the LASSI subscale scores, and indices of learning in college; and (2) to 
address the question of whether the metacognitive knowledge monitoring skills are 
gener aliz able across academic domains. 



METHOD 



Participants 

A total of 120 undergraduates from an urban college participated in the study, 73 females 
and 47 males. Participants were recruited from an introductory psychology course, and 
were awarded extra course credit for taking part in the study. 



Knowledge Monitoring Across Domains 



5 



Materials and Procedures 

Experimental materials in this study were administered in three distinct large-scale (N=40) 
testing sessions. At the beginning of each session participants were administered a paper- 
and-pencil version of the Learning and Study Strategies Inventory (LASSI). The LASSI is 
a 77-item self-report instrument that includes ten subscales: Attitude, Motivation, Time 
Management, Anxiety, Concentration, Information Processing, Selecting Main Ideas, 

Study Aids, Self Testing, and Test Strategies. The individual items on each scale are 
presented using a 5 point Likert-type scale. The LASSI scales have reported reliabilities that 
range from a = .68 to .86 ( Weinstein et al., 1987). After completing the LASSI, the KMA 
measures were administered to participants in a group setting. 

Two KMA measures were administered: the first, the KMA verbal (KMAV), 
included the presentation of 39 words adopted from the Nelson-Denny Vocabulary 
subscale (Riverside Press, 1979) appropriate for post-secondary students, with difficulty 
estimates ranging from easy (p =.84) to hard (p =.43); the second KMA, mathematics 
(KMAM), included the presentation of 21 math problems adapted from the Preliminary 
Scholastic Assessment Test (College Board, 1994). Each of the KMA items was presented 
singly to the participant groups using a Performa computer projection device. The KMA 
math items were programmed to remain visible for a delay of 20 seconds, the vocabulary 
words were presented for 8 seconds. The proper delay was determined for each of the two 
sets of items in an earlier pilot study. The delay was designed to afford the participants 
only enough time to read the problem, quickly determine if they could solve it, and indicate 
this on a response form. 

Participants were instructed to view the math problems and vocabulary items and 
assess whether they could or could not answer the item correctly, if given enough time. ' 
They were then asked to indicate, separately, the degree of confidence they had in that 
decision. The degree of confidence was presented in a 5 point Likert type scale ranging 
from 0 to 100% confident Following the estimates, participants were asked to complete a 
form indicating their current and projected grades in Mathematics and English subject areas. 
Participants were then administered the paper-and-pencil multiple-choice math and 
vocabulary tests which contained the identical sets of items presented earlier. The 21 item 
math test and the 39 item vocabulary test were scored as correct or incorrect, and the 
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Hamm an coefficient (Schraw, 1995), a measure of the accuracy of the estimates, was 
computed for each participant 



RESULTS 

Following suggestions made by Schraw (1995), the KMA math and vocabulary scoring 
methods discussed earlier were transformed from simple measures of association or 
recognition to a measure of the accuracy of the knowledge monitoring estimates. The 
Hamm an coefficient (HC) described by Romesberg (1984) and subsequently discussed by 
Schraw (1995), was used to transform the KMAV and KMAM scores into the appropriate 
metric for subsequent analyses. In general, the HC, and by extension the KMAV and 
KMAM, varies from -1 to 1, with higher values indicating more accurate estimates of 
knowledge. Both the KMAV and KMAM scores were related to students’ academic 
achievement using their undergraduate gpa’s, as well as to scores derived from the LASSI 
subscales. The zero-order correlations of the two KMA scores, the confidence estimates, 
the LASSI subscales, and gpa are presented in Table 1. 

INSERT TABLE 1 HERE 

The correlation between the two KMA measures, math (KMAM) and word 
knowledge (KMAV) was significant, r = .49 (p < .01), suggesting that knowledge 
monitoring abilities tend to generalize, albeit not very powerfully, across academic 
domains. The estimates of students’ confidence in their knowledge monitoring abilities 
with reference to test response were also moderately correlated with metacognitive 
performance in the math (r = .53, p< .01) and verbal (r = .30, p < .01) domains. 

Students’ confidence in their estimates were more weakly correlated across the math and 
verbal domains (r = .2653, p< .01), suggesting that domain specificity may be more salient 
for this type of confidence measure. 

In Table 1 there are twenty zero-order correlations reported for the LASSI subscales 
(N=10) and the two KMA measures. Of the twenty, only four were significant and, 
somewhat unexpectedly, they were all negative. The correlations, for example, between 
KMAM and LASSI measures of motivation, mental self-testing, and time management 
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drills (r = -.24, -.21, and -.23 (p< .05), respectively), as well as the correlation between 
KMAV and mental self-testing (r = -.19 (p< .05), indicate that students’ self-reports of 
poor strategy use and undeveloped skills in these areas was not aligned with their 
metacognitive knowledge monitoring as measured more objectively with the KMA 
procedure. Interestingly, both the two KMA scores and the LASSI subscale scores were, 
for the most part, significantly correlated with academic achievement as measured by gpa. 

Multiple regression methods were used to explore further students’ KMA scores, as 
well as the complex relationship of their KMA scores, LASSI self-reports, and academic 
achievement Looking first at the math KMA scores, the results of the regression analyses 
suggest that both the students’ confidence estimates and their self-reports of academic 
motivation explain a significant portion of the variance ( R 2 = .33, F (2, 1 13) = 27.94, p < 
.001). With respect to the vocabulary word knowledge KMA scores, the regression 
analysis reveals that students’ confidence estimates and their self-reports of the self-testing 
strategies explain a small, but significant, proportion of the variance ( R 2 = .21, F (2, 109) 
= 14.78, p < .001). As noted earlier, in both of these exploratory measurement models 
the LASSI self-report measures were negatively related to performance on the KMA’s. 

In order to understand the joint influences of the KMA scores and LASSI self- 
reports on academic success, multiple regression analysis was used in much the same way. 
The dependent variable in these analyses, however, was the total gpa as reported by the 
college. The regression analyses suggested that the KMA verbal score, as well as the 
LASSI subscale measuring self testing and reviewing strategies, explained a portion of the 
variance in students’ gpa variance ( R 2 = .23, F (2, 104) = 15.91, p < .001). It is 
important to note that the math KMA score did not enter the regression equation, and that 
the LASSI test-taking subscore, unlike the other LASSI scores discussed earlier, was 
positively related to academic achievement (See Appendix A for a more complete 
presentation of the regression analyses.) 



DISCUSSION 

Knowledge monitoring is an important component of academic success. The findings of 
this study, along with findings of a series of studies in this area (Everson and Tobias, in 
press; Tobias and Everson, in press) support this general conclusion. Moreover, this study 
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continues a linp. of research that supports the validity of the KMA, both in terms of the 
construct of metacognitive knowledge monitoring and the predictive validity of the 
assessment procedure. Interestingly, the results of this study suggest that knowledge 
monitoring may have a relatively large domain specific component, and that a general 
metacognitive knowledge monitoring ability may be context-bound. This argues, we 
suspect, for developing KMA procedures that are more domain specific, e.g., in science 
and social science. On the other hand, the vocabulary KMA scores more successfully 
differentiated the academically capable students than did the math KMA scores in this 
study, par tiall y replicating findings reported elsewhere (Tobias and Everson, 1996). Also, 
the correlation between the verbal KMA score and gpa was higher than for the math KMA. 
This suggest that verbal metacognitive knowledge monitoring scores may be more salient 
predictors of college, since effective learning may be largely related to students’ ability to 
process text-based materials across a variety of academic domains. Given the large body of 
research indicating that vocabulary test scores are one of the most powerful predictors of 
school learning (Breland, Jones, & Jenkins, 1994; Just & Carpenter, 1987), this finding is 
not altogether surprising. 

Learning in complex domains such as science and engineering, or making 
diagnoses in medicine or other fields, often requires that students bring substantial amounts 
of prior learning to bear in order to understand and acquire new knowledge or solve 
problems. Some prior learning may be recalled imperfectly, or may never have been 
completely mastered during initial acquisition. Students who can accurately distinguish 
between what they know and do not know should be at an advantage while working in 
such domains, since they are more likely to review and try to relearn imperfectly mastered 
materials needed for particular tasks, compared with those who are less accurate in 
estimating their own knowledge. In view of the fact that the knowledge monitoring scores 
reported in the study, i.e., math and word knowledge, shared about 25% of the variance 
between them, it would be useful to develop a KMA procedure in the science domain to 
determine its relationship to achievement in science and engineering. 

Several factors are likely to have reduced the magnitude of the effects and the 
generalizability of the results to other groups of college students. First, many of the 
students in this sample took less than a full-time schedule of courses. That fact is likely to 
have decreased the reliability of the gpa, because it was based on fewer courses and credits 
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than is usually the case after a year of college. Second, it is well known that college grades 
are often unreliable (Werts, Linn & Joreskog, 1978; Willingham, Lewis, Morgan, & 

Rami s t, 1990), reducing the magnitude of any correlations with them. The reliability of the 
grades may have been reduced further by three factors: a) students took dissimilar courses; 
b) when similar courses were taken they were often taught by different instructors; and c) 
the differences in students' major fields of study. Criteria other than summary gpa’s need 
to be considered in future research studies. 

Further research is also needed to determine the relationships between the KMA 
procedure and self-report measures of metacognition, study skills, and self-regulated 
learning strategies measured by the LASSI . Since these constructs are theoretically related 
to measures obtained with the KMA, a positive empirical relationship between the KMA 
scores and the LASSI subscales was expected. Surprisingly, none were found in this 
sample of college students. It is not clear whether these findings would be supported if the 
LASSI were administered earlier in the students’ academic careers, before they experienced 
a full measure or academic success or failure. We suspect there may be issues related to the 
method variance, i.e., self-report versus objective scoring, in these two assessment 
techniques. Finally, the relationship between knowledge monitoring ability, learning and 
study strategies, and measures of intelligence should be investigated. Sternberg (1991) has 
suggested that metacognition should be a component of intelligence tests; presumably those 
who consider metacognition an executive process (Borkowski, Chan, and Muthukrishna, 
in press) would also agree with that recommendation. Research findings (Schraw, in 
press) indicate that academically able students have higher knowledge monitoring ability 
than those less able. Therefore, positive relationships between the KMA procedure and 
measures of general intellectual ability may be expected. It remains for further research to - 
explore that possibility. 
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APPENDIX A 

* * * * MULTIPLE REGRESSION * * * * 
Listwise Deletion of Missing Data 

Equation Number 1 Dependent Variable.. KMA Verbal 

Block Number 1. Method: Forward Criterion PIN .0500 

VCONFIDENCE SFT 



Variable (s) Entered on Step Number 

1.. VCONFIDENCE voc test conf mean 



Multiple R .42060 
R Square- . 17690 
Adjusted R Square .16942 
Standard Error .28098 

Analysis of Variance 





DF 


Sum of 


Squares 


Mean Square 


Regression 


1 




1.86648 


1.86648 


Residual 


110 




8.68433 


.07895 


F = 23.64170 




Signif F = 


.0000 





Variables in the Equation : 

Variable B SE B Beta T Sig T 

VCONFIDENCE .161018 .033116 .420599 4.862 .0000 

(Constant) -.263157 .124218 -2.119 .0364 

Variables not in the Equation 

Variable Beta In Partial Min Toler T Sig T 

SFT -.191012 -.210520 .999803 -2.248 .0266 



Equation Number 1 Dependent Variable.. KMA Verbal 

Variable (s) Entered on Step Number 
2 . . SFT 

Multiple R .46193 

R Square .21338 

Adjusted R Square .19895 

Standard Error .27594 

Analysis of Variance 





DF 


Sum of 


Squares 


Mean Square 


Regression 


2 




2.25135 


1.12568 


Residual 


109 




8.29946 


.07614 


F = 14.78395 




Signif F = 


.0000 
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Variables in the Equation 



Variable 


B 


SE B 


Beta 


T 


Sig T 


VCONF IDENC E 


.162045 


.032525 


.423283 


4.982 


.0000 


SFT 


-.010484 


.004663 


-.191012 


-2.248 


.0266 


(Constant) 


.014838 


.173697 




.085 


.9321 



End Block Number 1 All requested variables entered. 



Equation Number 1 Dependent Variable.. KMA Math 

Block Number 1. Method: Forward Criterion PIN .0500 

MC CONFIDENCE MOT TMT SFT 



Variable (s) Entered on Step Number 

1.. MCONFIDENCE math test conf mean 



Multiple R .53180 
R Square .28281 
Adjusted R Square .27652 
Standard Error .34784 

Analysis of Variance 





DF 


Sum of Squares 


Mean Square 


Regression 


1 


5.43915 


5.43915 


Residual 


114 


13.79341 


.12099 


F = 44.95356 




Signif F = .0000 





Variables in the Equation 



Variable B SE B Beta T Sig T 

MCONFIDENCE .294806 .043970 .531798 6.705 .0000 

(Constant) -1.028385 .174755 -5.885 .0000 



Variables not in the Equation 



Variable 


Beta In 


Partial 


Min Toler 


T 


Sig T 


MOT 


-.219367 


-.258839 


.998507 


-2.849 


.0052 


TMT 


-.203835 


-.240406 


.997626 


-2.633 


.0097 


SFT 


-.180162 


-.212309 


.995966 


-2.310 


.0227 



1 
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Equation Number 1 Dependent Variable.. KMA Math 



Variable (s) Entered on Step Number 
2 . . MOT 

Multiple R .57520 
R Square .33086 
Adjusted R Square .31902 
Standard Error .33747 



Analysis of Variance 

DF 

Regression 2 

Residual 113 



Sum of Squares 
6.36327 
12.86929 



F = 



27.93667 



Signif F = .0000 

Variables in the Equation 



Mean Square 
3.18164 
.11389 



Variable 


B 


SE B 


Beta 


T 


Sig T 


MCONFIDENCE 

MOT 

(Constant) 


.290108 

-.016322 

-.494490 


.042691 

.005730 

.252732 


.523322 

-.219367 


6.796 

-2.849 

-1.957 


. 0000 
.0052 
.0529 



Variable 

TMT 

SFT 



- Variables not in the Equation 
Beta In Partial Min Toler 



-.115809 -.115549 .666135 

-.090131 -.093825 .725118 



T Sig T 

-1.231 .2209 

-.997 .3207 



End Block Number 



PIN = 



.050 Limits reached. 



Listwise Deletion of Missing Data 
Equation Number 1 Dependent Variable.. 



TOTGPA total gpa 



Block Number 1- Method: Forward 

KMAV KMAM TST ATT 

Variable (s) Entered on Step Number 
1.. TST 

Multiple R .39284 

R Square .15432 

Adjusted R Square .14627 

Standard Error .70451 

Analysis of Variance 



Criterion PIN .0500 



MOT 



SMI 





DF 


Sum of Squares 


Mean Square 


Regression 


1 


9.50993 


9.50993 


Residual 


105 


52.11437 


.49633 
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F = 19.16059 Signif F = .0000 



Variables in the Equation 

Variable B SE B Beta T Sig T 

TST .049843 .011387 .392837 4.377 .0000 

(Constant) 1.365726 .341756 3.996 .0001 





VariabI 


Les not in 


the Equation 






Variable 


Beta In 


Partial 


Min Toler 


T 


Sig T 


KMAV 


.286486 


.307587 


.974846 


3.297 


.0013 


KMAM 


.192832 


.209263 


.995939 


2.182 


.0313 


ATT 


.114426 


.091456 


.540237 


.937 


.3511 


MOT 


.069448 


.059754 


.626066 


.610 


.5429 


SMI 


-.100695 


-.073817 


.454469 


-.755 


.4520 


Equation 


Number 1 


Dependent 


Variable . . 


TOTGPA 


total 



Variable (s) Entered on Step Number 
2 . . KMAV 



Multiple R .48408 
R Square .23433 
Adjusted R Square .21961 
Standard Error .67357 



Analysis of Variance 





DF 


Sum of Squares 


Mean Square 


Regression 


2 


14.44046 


7.22023 


Residual 


104 


47.18384 


.45369 


F = 15.91442 




Signif F = .0000 





Variables in the Equation 



Variable 


B 


SE B 


Beta 


T 


Sig T 


KMAV 

TST 

(Constant) 


.697768 

.044078 

1.297522 


.211663 

.011026 

.327402 


.286486 

.347401 


3.297 

3.998 

3.963 


.0013 

.0001 

.0001 



Variables not in the Equation 



Variable 


Beta In 


Partial 


Min Toler 


T 


Sig T 


KMAM 


.068519 


.067734 


.732381 


.689 


.4924 


ATT 


.133450 


.111964 


.528161 


1.143 


.2555 


MOT 


.147008 


.130235 


.587886 


1.333 


.1854 


SMI 


-.091812 


-.070718 


.447584 


-.720 


.4735 




1. Zero-Order Correlations of LASSI Subscales, Knowledge Monitoring Measures, Confidence Estimates, and QPA 









« 




« 


« 


© 






o 


* 


co 


• 


« 


© 


> 




o 


co 


h- 


CM 




h- 


< 




o 


CM 


CD 




o 


CD 






o 






o 


CM 








1 -' 


CM 


o 


co 




© 






« 


« 


« 










o 


« 


« 


« 


05 




• 




o 


CO 


05 


05 


CO 


o 


CM 




o 


o 


05 


O 


CD 




CO 




o 


05 




CO 




T— 


CO 


2 


- 




co 


to 


o 


o 


CM 



o 

ERIC 






& 






IS 



lid 



Is 



o 

O TT 

o -<r 

o T- 

^ o 



o 

o 

o 

o 



« to 
co o 
to o> 

CD O 



o 

o 

o 

o 



CO 

h- 

o 



o 



^ CO 
CD CM 



o o 



O 


« 

« 


« 

« 


CO 


to 


O 


CM 


CO 


CD 


co 


O 


CM 


to 




T- 


O 


M- 


CD 


. 


T— 


^ . 


to 


CM 


o 


o 



o 

o 

o 

o 



• 

CO 


05 


CM 




05 


05 


o 




to 


CM 


CM 




o 


o 


o 


CM 

#" 


d 


d 


d 


d 



CO • 
CD 

CM h- 
CO 



TST 






O 

O 

O 

o 


« 

« 

co 

05 

05 

CO 


0.025 


0.1445 


0.0715 


0.0673 


0.0307 


« 

« 

CD 

CM 

O 

CD 


« 

« 

to 

CO 


C 

05 

CO 

« 

« 






o 


« 


« 

« 




to 


« 

« 


to 


00 


00 


« 








o 




M’ 


05 




05 




CD 


TT 


05 




<< 




o 


CO 




Q 


o 


TT 




CO 


O 




JO 






o 


CD 


O 






to 


o 


o 






o 


CO 




y— 


T“ 




o 


d 


CM 


o 


o 


o 


CM 


V 






























o 


« 


© 


« 


fs. 


to 






CD 


« 


« 


c 




o 


to 


CD 


CM 


05 




Tf 


T— 


co 


h* 


to 


05 




o 


CM 




M* 


Q 


05 


CO 




CM 




05 


CO 




o 


o 


*r 


to 




o 


Y— 


o 


o 


O 


M- 




w 




CM 




•*r 


o 


o 


o 


o 


o 


CM 


CM 


« 



o 

o 


« 

« 

CM 


« 

« 

CO 


« 

« 

h- 


« 

« 

CO 


« 

CM 

CO 


« 

CM 

© 


05 

o 


o 


05 


h- 


CM 


M’ 


05 


h- 


o 


CM 


CM 




•V 


CM 




o 




-O' 


CD 


CO 


to 


• 


o 



co o> 

CD CD 

o o 



to CO 
o 

M’ 

O <r- 

o o 



o 












CD 


CD 




h- 


co 


CM 


« 

« 


o 


to 


05 








05 


to 


05 




co 


co 


co 


o 






05 




CO 


co 


Q 


CD 


o 


to 


o 


o 


o 


CM 


05 


CD 


o 




CM 








o 




CD 




to 


to 


CM 


to 


to 




o 


o 


d 


o 


o 


CM 



o 

O lO 

o o 

O T- 



CD 

h- 

lO 



to 

o 



CM 05 
y- Tf 

CD 



CO 05 

to to 
o o 



to 

5 



CD 

o ° 



h- r: 

_ GO 

o <=> 















CD 






CO 


CM 


O 


o 


o 


o 


o 


q 


o 


3 

o 




c 

© 


0 






TJ 

c 

© 






































3 




xs 


do 




05 










o 

o 




co 


O 


co 


CD 


to 


CO 


05 

to 


CM 

Q 


h- 

CD 


h- 

co 


CD 


« 


« 

CO 


0 




QJ 

•o 


c 

m 




c 

5 


© 

© 








o 


h- 


CM 


CO 


CM 




M- 


CO 




Q 


05 




Q 


CD 


1^ 


tT 




c 


m 




© 


*o 








o 


to 




CO 


to 


T“ 


o 


o 


, 




o 


o 




to 


CM 


o 




© 


8 




*5 




o 








CM 


CD 


M- 


CD 


CO 




CD 


o 


o 


o 


o 


d 


CM 


CM 






c 

o 


& 




£ 








o 


« 

« 


« 

* 


« 

« 


« 

« 


« 

« 




« 

« 


« 

« 


fs. 


co 


h- 


05 


CM 


« 

« 


« 

« 


*o 

c 




I 


Q. 

c 


c 


05 


E 






o 


h- 


CD 


h- 


CO 




CD 


Tf 




o 


h- 








CD 




© 






£ 


o 


c 


05 






o 


T— 


00 


CM 


CO 




CO 


CM 


CO 




to 




o 


CM 


h- 


o 


>N 


© 


c 






0 


c 






o 


o 


h* 


CD 


05 


CO 


r- 


h- 


TT 


. 


o 








1^- 


05 




*D 


8 


© 


§ 


© 




< 






q 


CM 


CD 


CM 


to 


o 


<D 


TT 


o 


o 


o 


o 

■ 


o 


CM 


CM 


*1 




c 

o 


i 


o 




o 

© 




o 


« 

« 


« 

« 




« 

* 


TT 


« 

* 


co 


« 

« 


« 

« 


CD 


05 


« 


« 


co 


« 

« 


« 


c 

< 


< 


o 


o 

c 


2 


■© 

CO 


© 

CO 




o 


CO 


TT 


TT 


to 




CO 


to 


CO 


h- 


CO 


co 


h- 


CO 


o 




Tt 


• 


• 


• 




• 


t 


• 


y 


o 


05 


O 


05 


CO 


to 


to 


o 


00 


TT 


CD 


r- 




o 


■<r 




05 


x 




z 


* 


t— 






9 


o 




05 


o 




o 






h- 


N 






o 


CO 






CM 


z 


L_ 


o 


CL 


O 


t 


5 


< 


1-* 


to 


to 


d 


CO 


d 


■M- 


d 

< 


to 


CM 


o 


o 


CM 


CM 


o 


© 


CM 


< 


< 


o 


z 


2 


CO 


CO 




1 

3 

E 

o 

u 

5 



JD 

O 

£ 

8 

0 

© 

1 

c 

•c 

Q. 

© 



1 

© 

CM 



o 

v 



CO 

CN> 




o o o o 

O O O K 



© 

o 



2 

s. 

o 

2 

8 



8 

0 

E 

*o 

c 

© 

© 

05 

"O 

© 



05 

c 

’C 



o 

v 

© 



.2 

c 



IU 

-J 

CD 

3 

§ 

O 

o 

LU 

CQ 



-= © » 



05 

C 



O & 



c 

05 

8 

6 



® © 
© 

E £ 

c ©> 

« -S 
© <« 
© CL 
3 m 

f - 

-C -o 

1 § 

t ® 

I ™ 

Q. Q) 

3 g 



8 m 
© 

=5 H 



2 

(0 



<0 






CM 

ej- 



AREA' 1997 




U.S. DEPARTMENT OF EDUCATION 

Olllce ol Educational Research and Improvement (OERI) 
Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 

(Specific Document) 



® 




7 % 



I. DOCUMENT IDENTIFICATION: 



r " le Do tW Sfc((s at*o u/aiCj $(72#ir&>(eT //^/ feru 

Accost ? 



Aumor(s) f$ t E\se£w, X d /< L41 rvSfi 

Corporate Source: 

Gtte&e 



Publication Date: 



II. REPRODUCTION RELEASE: 



In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents 
announced m the monthly abstract journal of the ERlC system. Resources in Education (RIE), are usually made available to users 
in microfiche, reproduced paper copy, and electronic/optical media, and sold through the ERIC Document Reproduction Service 
(EDRS) or other ERIC vendors Credit is given to the source of each document, and. if reproduction release is granted, one of 
the following notices is affixed to the document. 

If permission is granted to reproduce the identified document, please CHECK ONE of the following options and sign the release 
below. 



Check here 

Permitting 

microfiche 

(4"x 6” film). 

paper copy. 

electronic. 

and optical media 

reproduction 



Sample sticker to be affixed to document 



‘•PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERlC)." 



Lewi 1 



Sample sticker to be affixed to document 



"PERMISSION TO REPRODUCE THIS 
MATERIAL IN OTHER THAN PAPER 
COPY HAS BEEN GRANTED BY 

TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



Level 2 



or here 

Permitting 
reproduction 
in other than 
paper copy. 



Sign Here, Please 

Documents will be processed as indicated provided reproduction quality permits. If permission to reproduce is granted, but 
neither box is checked, documents will be processed at Level 1 . 



“1 hereby grant to the Educational Resources Information Center (ERlC) nonexclusive permission to reproduce this document as 
indicated above. Reproduction from the ERlC microfiche or electronic/optical media by persons other than ERIC employees and its 
system contractors requires permission from the copyright holder. Exception is made for non-profit reproduction by libraries and other 
service agencies to satisfy information needs of educators in response to discrete inquiries." 




Ros, " on ' C/tMl Jcm&yt 


Printed Name: / / _ _ _ > 




Mfo ^7 /ootHWl 


Telephone Number. ^ > fa ft 0 \ 


Date: 




OVER 



CUA 




THE CATHOLIC UNIVERSITY OF AMERICA 

Department of Education, O’Boyle Hall 
Washington, DC 20064 
202 319-5120 



February 21, 1997 
Dear AERA Presenter, 

Congratulations on being a presenter at AERA 1 . The ERIC Clearinghouse on Assessment and 
Evaluation invites you to contribute to the ERIC database by providing us with a printed copy of 
your presentation. 

Abstracts of papers accepted by ERIC appear in Resources in Education (R1E) and are announced 
to over 5,000 organizations. The inclusion of your work makes it readily available to other 
researchers, provides a permanent archive, and enhances the quality of RIE. Abstracts of your 
contribution will be accessible through the printed and electronic versions of RIE. The paper will 
be available through the microfiche collections that are housed at libraries around the world and 
through the ERIC Document Reproduction Service. 

We are gathering all the papers from the AERA Conference. We will route your paper to the 
appropriate clearinghouse. You will be notified if your paper meets ERIC's criteria for inclusion 
in RIE: contribution to education, timeliness, relevance, methodology, effectiveness of 
presentation, and reproduction quality. You can track our processing of your paper at 
http : / / er icae2 . educ. cua.edu. 

Please sign the Reproduction Release Form on the back of this letter and include it with two copies 
of your paper.*. The Release Form gives ERIC permission to make and. distribute copies of your 
paper. It does not preclude you from publishing your work. You can drop off the copies of your 
paper and Reproduction Release Form at the ERIC booth (523) or mail to our attention at the 
address below. Please feel free to codv the form for future or additional submissions. 

Mail to: 



This year ERIC/AE is making a searchable uonierence rrogram available on the AERA web 
page (http://aera.net). Check it out! 





'Lawrence M. Rudner, Ph.D. 
Director, ERIC/AE 



‘If you are an AERA chair or discussant, please save this form for future use. 



EHIC| Clearinghouse on Assessment and Evaluation 



